The "Presença" project is an interactive audiovisual installation where the video displayed on a screen undergoes glitches according to the proximity of the observer, as detected by a distance sensor. The theme of our video is based on a visual exploration of mosses, lichens, and fungi in Portugal.
Mosses, lichens, and fungi are among the oldest life forms on our planet. Their variety of colours and appearances may be as impressive as their resilience to environmental changes, but even that resilience does not fully shield them from human presence and its consequences.
Six compositions inspired by the biodiversity of these species are alternated in a video playing on a screen, complemented by a soundtrack. As the viewer approaches the screen, disruptive effects occur in both sound and image. To fully appreciate these visuals, maintaining some distance is necessary.
The title "Presença" (Presence) refers to both the essential (and sometimes forgotten) presence of these beings in our flora and to human presence and its consequences.
The goal was to create an immersive atmosphere in the space where the installation is located. This involves incorporating a certain level of chilliness and darkness that reflects the theme of the project, which in turn allows the viewer to be fully engrossed in the audiovisual experience.
You can check it out more on my Youtube account.
Image Production
Visual processing was primarily carried out using Krita and TouchDesigner.
Six images of different compositions were created, using a combination of photomontages from originals photographs, and others sourced from the internet, along with digital painting.
Photos taken by Daniela Moreno (me)
The images were then imported into the TouchDesigner program, where movement was applied to them using an effect that conveyed a sense of fluidity and vitality to the compositions.
Sound Design
Using FL Studio, we aimed to create a sound that stemmed from an idea of nature and spirituality, yet simultaneously bore some human and technological influence. Thus, amidst the abstract sound at the beginning and end, a melody was crafted from various sounds of virtual synthesizers, attempting to replicate the sound of different instruments such as violins, pianos, bass, kalimba, and bells.
After arranging the sounds and creating the notes, several post-production effects were used to create a more mystical and atmospheric environment.
Next, with the help of Audacity, we compressed the original sound, resulting in a poor quality output. Additionally, pre-made glitch effects were layered over the audio. In this way, we had two audio tracks to accompany the degradation (or lack thereof) of the video.
Technical Programming
Based on the TinkerCad experiments, we constructed a circuit with an HC-SR04 ultrasonic sensor and an Arduino to create an installation sensitive to the proximity of the viewer. The NewPing library was used to enhance the sensor's performance and facilitate its usage in the project.
In Processing, the frames corresponding to the video undergo a process of pixel sorting (adapted from the script by artist Kim Asendorf). The original video plays normally until the sensor detects values below 400 cm, causing the layer of pixel-sorted frames to become increasingly opaque as an obstacle approaches the sensor, enabling the glitch effect. Similarly, the sound also changes according to the distance of the viewer:
the closer they are to the sensor, the louder the glitch sound will be, and the farther away they are, the louder the original sound will be.
Exhibition Simulation
The simulation video of the installation, was filmed at the entrance of the college chapel, a dim and humid location that serves as a fitting backdrop for the development of the beings involved. We envisioned how our installation would appear in real life, adding a screen in post-production as a support for the installation.
Our goal was for the video to showcase the interaction between the installation and the viewer, capturing possible reactions from both.
Programming: Silvana Mariano & Érica Oliveira
